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Abstract 

Objectives: To adapt the Assessing Care of Vulnerable Elders Quality Indicators (ACOVE Qls) for use in Italy, to assess the 
adherence to these indicators as reported in the medical records of residents in a nursing home (NH), to compare this 
adherence for general medical and geriatric conditions, and eventually, to identify the relationships between patients' 
characteristics and reported processes of care. 

Methods: Two physicians collected the data by reviewing medical records of all NH residents in the previous 5 years, for a 
period of one year. Patients aged <65 years were excluded. A total of 245 patients were reviewed during the study period. 
The ACOVE Qls set, developed for NH processes of care, was used to assess the quality of care. Multivariate analysis was 
performed to identify and to assess the role of patients' characteristics on quality of processes of care by several domains of 
care in general medical and geriatric conditions. 

Results: With the exception of diabetes management, quality of processes of care for general medical conditions 
approached adequate adherence. Care falls substantially short of acceptable levels for geriatric conditions (pressure ulcers, 
falls, dementia). On the contrary, the recommended interventions for urinary incontinence were commonly performed. 
Adherence to indicators varied for the different domains of care and was proven worse for the screening and prevention 
indicators both for geriatric and general medical conditions. Statistical analysis showed disparities in provision of 
appropriate processes of care associated with gender, age, co-morbidities, level of function and mobility, length of stay and 
modality of discharge by NHs. 

Conclusions: Adherence to recommended processes of care delivered in NH is inadequate. Substantial work lies ahead for 
the improvement of care. Efforts should focus particularly on management of geriatric conditions and on preventive 
healthcare. 
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Introduction 

In recent decades an exponential growth in numbers of 
vulnerable elders has led to the concept of emerging new needs 
associated with their increasing disabilities, and concomitantly an 
increasing but transformative new demand for health care 
requiring formal long-term support. Long-term care represents a 
program of health care, personal care and social services delivered 
over time to persons who have lost or never acquired some 
nominal degree of functional capacity [1]. These services may be 
provided in a variety of settings, largely accounted for in Nursing 
Homes (NHs). 

Older patients, as highlighted in a recent review article, do not 
receive appropriate care [2], so innovative quality improvement 
strategies still need to be designed, developed and implemented in 
settings now delivering suboptimal care [3,4]. To explore where, 
when and for which conditions quality deficiencies exist, Rand 
Corporation developed a comprehensive set of indicators for 
assessing the quality of the processes of care, rather than of the 



outcomes, namely the Assessing Care Of Vulnerable Elders 
(ACOVE) quality indicators (Qls) [5,6]. These Qls represent 
minimum care rather than optimal care to be provided for general 
medical and geriatric conditions to the vulnerable elders, and are 
meant to assess and ultimately improve the quality of care [5,6] . 

In Italy there is limited experience about the use of standardized 
indicators to assess the quality of care provided to NH resident 
elders, and no study has examined quality of processes of care 
delivered to prevent, diagnose and treat the main general medical 
conditions compared to the geriatric ones. 

The aims of our study were to adapt the ACOVE Qls in a 
specific geographic area of Italy, to assess the adherence to these 
indicators as reported in medical records of residents in a NH, to 
compare this adherence for general medical and geriatric 
conditions, and eventually, to identify the relationships between 
patients' characteristics and reported processes of care. Our data 
may contribute to implement Qls on a large scale, thus promoting 
the adoption of best practices in NHs. 
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Materials and Methods 

The study was undertaken in one 40-bed NH facility located in 
the area of Catanzaro (Italy). The catchment area of Catanzaro 
encompasses about 240.000 inhabitants and 1.635 sq km. It is 
served by six NHs for a total of 194 beds. 

Two previously trained physicians, who were not involved in 
care, collected the data by reviewing medical records of NH 
residents. A detailed protocol has been used to train reviewers to 
extract data from medical records. In the protocol, simulations of 
the most common situations that the reviewers would find in the 
medical records were also included. Finally, the first 30 medical 
records were reviewed together by two physicians and all 
discrepancies were resolved through discussion, re-reading and 
the possible intervention of a third reviewer. 

Data were collected for all patients who had been NH residents 
for at least one year in the previous 5 years (2001 to 2006). If 
patients were admitted for more than one year, the previous 12 
months of stay were evaluated; patients aged less than 65 were 
excluded. The following data were collected for each patient: 
socio-demographics, mode of admission to NH, cognitive and 
functional health status, and delivered processes of care. To assess 
the clinical conditions of patients, we collected the individual 
diagnoses and the Cumulative Illness Rating Scale for Geriatrics 
(CIRS-G index) [7,8], a clinician-rated scale of cumulative medical 
burden in geriatric patients. Two CIRS-G indices were used: the 
14 CIRS-G severity index, represented by the disease severity 
mean (ranging from 1, no problem, to 5, extremely severe) in each 
of 14 organ systems, and the 14 CIRS-G comorbidity index, 
computed by counting the number of items for which a score of 3 
or more was reported. Cognitive status was assessed using the 
Short Portable Mental Status Questionnaire (SPMSQ [9], and the 
level of function and mobility using the Barthel index [10]. 

The ACOVE QI set, developed for NH processes of care, and 
covering 1 1 general medical conditions [1 1] and 6 geriatric 
syndromes [12] was used to assess the quality of care. 

The ACOVE QIs have been subjected to a cross-cultural 
translation and adaptation process into the Italian language. The 
process of cross-cultural adaptation involved several steps: 1) 
translation from English to Italian; 2) establishment of an expert 
committee that included two experienced researchers in internal 
medicine and geriatrics, three researchers proficient in survey 
design and cross-validation method, one language professional and 
one translator; 3) meeting of the expert committee to produce the 
first Italian draft; 4) pilot-testing on a focused group of charts; 5) 
meeting of the expert committee to produce a new consensus 
version; 6) back-translation to English; 7) re-evaluation by the 
committee members and production of the final draft. Then, a 
pilot study was conducted in order to test the final draft of the tool. 
Subsequently, the translated version of the tool was submitted to a 
group of experts who were senior researchers in public health, in 
internal medicine and geriatrics. They reviewed the format and 
content of the items, as well as the content validity of the tool as a 
whole. Eventual disagreement between physicians in reviewing 
medical records was resolved by discussion. 

We selected 4 medical conditions (hypertension, diabetes 
mellitus, heart failure, pneumonia and influenza) (Appendix SI) 
and 4 geriatric syndromes (dementia, urinary incontinence, falls 
and mobility disorders and pressure ulcers) (Appendix S2); the 
clinical conditions were selected since they were the most 
frequently encountered ones in the study population. Several 
indicators were assessed for each condition (Hypertension = 13, 
Diabetes mellitus =11, Heart failure = 9, Pneumonia and Influ- 



enza =8, Dementia =13, Urinary incontinence = 6, Falls and 
mobility disorders = 6, Pressure ulcer = 7). 

The ACOVE QIs are constructed in an IF/THEN format. The 
"IF" portion of the QI defines the eligible patient for a specific 
process of care, and the "THEN" portion defines the recom- 
mended care. So, "IF" in the patient's medical record that specific 
clinical characteristic was reported (eg. that NH resident had 
diabetes), "THEN" it was necessary to check whether the 
procedure described by the QI had been performed or not (eg. 
his or her glycosylated hemoglobin levels had been measured at 
least every 12 month). Therefore, each NH resident has been 
considered eligible in relation to one or more clinical conditions 
reported in the medical record. Whenever the condition described 
by one of the QI appeared in the medical record, a score of 1 was 
assigned if the process of care had been performed in adherence to 
the indicator, otherwise a score of 0 was attributed. For each 
patient the same indicator could be measured several times 
according to the recurrence of the condition in the medical record. 
If the patient had an identified contraindication to a process of 
care, the related indicator was not included in the scoring process. 
If feasibility of any indicator was questionable, it was not 
considered [12,13]. For each clinical condition, scores were 
calculated at the patient level as the percentage of adherence to 
the recommended process of care. For example, a patient who had 
1 medical conditions (hypertension), and 1 geriatric syndrome 
(dementia), might have been eligible for all 13 hypertension QIs, 
and for 1 1 of the 1 3 dementia QIs. If 7, and 4 QIs, respectively, 
were satisfied, the patient's mean quality score for hypertension 
would be calculated as 7:13 = 54%, and for dementia as 
4:1 1 = 36%. Moreover, the scores were also calculated by domain 
of care, categorized into three groups: screening and prevention, 
diagnosis and treatment. For instance, of the 1 3 indicators related 
to hypertension 3 belonged to the screening and prevention 
domain of care, 4 to the diagnosis, and 6 to the therapy. If the 7 
QIs satisfied were divided as the following: 1 QI in screening and 
prevention, 2 QIs in diagnosis and 4 QIs of therapy, the patient's 
mean quality score for each domain of care related to hypertension 
would be calculated as 1:3 = 33% for screening and prevention, as 
2:4 = 50% for diagnosis, and as 4:6 = 67% for therapy. 

Therefore we provided one QI score for each eligible clinical 
condition and for each domain of care. 

The Ethics Committee of the "Mater Domini" Hospital of 
Catanzaro (Italy) approved the protocol of the study. As a matter 
of course, written consent was always requested when admission to 
the NH occurred, and only the patients who had given permission 
for their personal data to be used for research were included in the 
study. 

Statistical analysis 

In the primary analysis, we used t-test to compare the mean 
level of the QIs scores for general medical and geriatric conditions 
in the three domains of care. Six multiple linear regression models 
were developed to evaluate the relationship of baseline indepen- 
dent characteristics with: QIs scores calculated in the three 
domains of care (screening and prevention, diagnosis and therapy), 
separated for general medical and geriatric conditions. 

In all 6 models the explanatory variables included were the 
following: age (£75 years = 1, 76-85 years = 2, ^86 years = 3), sex 
(male = 0, female =1), marital status (single/divorced/wid- 
owed = 0, married = 1), education level (no formal education = 0, 
>5 years =1), referral to NH (hospital/residential care servic- 
es = 0, home=l), length of NH stay (<18 months = 0, 19-36 
months = 1, &37 months = 2), outcome of NH stay (categorical, 
discharge =1, death = 2, transfer to another facility =3, NH 
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attendance = 4), 14 CIRS-G comorbidity index (continuous), 14 
CIRS-G severity index (continuous), Barthel index (total indepen- 
dence = 0, dependence: mild=l, moderate = 2, severe = 3, to- 
tal = 4), SPMSQ (cognitive function impairment: no = 0, border- 
line or mild=l, moderate = 2, severe = 3), medical/surgical 
examinations (no = 0, yes = 1), referral to emergency department 
(no = 0, yes= 1), hospital admission (no = 0, yes = 1). Regression 
coefficients (P), standard errors (SE) and 95% confidence intervals 
(CI) were calculated. All of the tests for significance were two-sided 
and p-values <0.05 were considered statistically significant. All 
analyses were conducted using the Stata software program, version 
11 [14]. 

Results 

Medical records for 245 patients were reviewed during the study 
period, and their main characteristics are presented in Table 1. 
More than half were referred to NH by hospitals or residential 
care services (56.3%), and the mean length of stay was 27.3 
months (standard deviation +15.8). Percentages of eligible patients 
varied for each clinical condition, ranging from 26.5 for heart 
failure to 100 for pneumonia and influenza. Adherence to quality 
processes of care according to clinical conditions investigated is 
found in Appendix SI and Appendix S2. 

A detailed examination of the appropriateness of care for 
individual conditions revealed that, among general medical 
conditions (Appendix SI), the mean level QI score for recom- 
mended processes of care for hypertension was 77.6%; almost all 
subjects had regular follow-up checks and received appropriate 
pharmacological management, but orthostatic blood pressure was 
rarely checked. The mean level QI score for diabetes melfitus was 
67.3%; almost all diabetics received regular blood pressure checks, 
annual foot examination and glycosylated haemoglobin checks, 
but fewer than 25% received an ophthalmologic examination. The 
mean level QI score for heart failure management was 81.8%; 
high compliance to specific physical examinations and complete 
medical history was found, but appropriate beta blockers 
prescriptions were provided only to 3 1 % of those eligible. Mean 
adherence rates for pneumonia and influenza, even though all 
patients were eligible, was 75.1%; almost all recommended 
interventions showed high compliance for patients with pneumo- 
nia. Formal strategies to increase vaccinations were usually 
adopted (85%), but influenza vaccine was administered three 
times more often than pneumococcal vaccine (90% vs 29%). 

Concerning geriatric conditions (Appendix S2), the mean level 
QI score for dementia reached 57%. In more than 90% of 
residents with cognitive impairment a validated cognitive assess- 
ment was performed, but only 34% were screened for depression. 
No medical records were found to indicate the registration of any 
bracelet identification. The mean level QI score for recommended 
interventions to prevent falls and treat mobility disorders was 
72.7%. Of eligible subjects, 96% were examined for balance or 
gait disturbances at admission, and more than two-thirds enrolled 
in exercise programs; however, hypotension screening was 
documented in only 14%. The mean level QI score for pressure 
ulcers was 63.2%. Appropriate risk assessment at admission and at 
recommended intervals was performed in 40% of eligible subjects, 
whereas 84% of residents with a pressure ulcer received this type 
of evaluation. For more than 90% of subjects appropriate topical 
therapy was applied, but adequate nutritional assessment was 
performed in only 22%. Compliance with urinary incontinence 
indicators was 82.7%. Among recommended interventions for 
urinary incontinence, the risk assessment at admission, the 
appropriateness of indications and documentation for catheteri- 
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Table 1. Selected Characteristics of the Study Population. 





Characteristic 


N 


% 


Mean+SD" 


Sex 


Male 


105 


42.9 




Female 


140 


57.1 




Age group, years 






81.7+8.2 


==75 


55 


22.4 




76-85 


94 


38.4 




==86 


96 


39.2 




Educational level, years of schooling 


None 


132 


53.9 




5 


77 


31.4 




8 


21 


8.6 




>13 


15 


6.1 




Marital status 


Single/Divorced/Widowed 


205 


83.7 




Married 


40 


16.3 




Access to NH b care 


Hospital/Residential care services 


138 


56.3 




Home 


107 


43.7 




Length of stay in the NH b , months 






27.3+15.8 


=218 


101 


41.2 




19-36 


86 


35.1 




>36 


58 


23.7 




Outcome of NH b stay 


Discharge 


81 


33.1 




Death 


63 


25.7 




Transferred to another facility 


39 


15.9 




Still in NH b 


62 


25.3 




Access to the Emergency Department 


None 


176 


71.8 




>1 


69 


28.2 




Medical/Surgical investigation received 


No 


33 


13.5 




Yes 


212 


86.5 




Cognitive function impairment (SPMSQ C ) 


Intact mental functioning 


3 


1.2 




Borderline or mild impairment 


21 


8.6 




Moderate impairment 


135 


55.1 




Severe impairment 


86 


35.1 




Level of function and mobility (Barthel index) 


Totally independent 


2 


0.8 




Mild dependence 


19 


7.8 




Moderate dependence 


52 


21.2 




Severe dependence 


85 


34.7 




Total dependence 


87 


35.5 




14 CIRS-G d Comorbidity Index 






5.9+2.1 


14 CIRS-G d Severity index 






2.1+0.4 



"Standard Deviation; b Nursing Home; c hort Portable Mental Status 
Questionnaire; Cumulative Illness Rating Scale For Geriatrics. 
doi:1 0.1 371 /journal.pone.0093064.t001 



PLOS ONE | www.plosone.org 



3 



March 2014 | Volume 9 | Issue 3 | e93064 



ACOVE Indicators' Use in Nursing Home in Italy 



zation and chronic indwelling catheter use were frequently 
followed and performed. In contrast, appropriate toileting 
programs and behavioral treatments were less frequently applied 

(25%). 

The adherence to indicators varied for different domains of care 
and was worse for screening and prevention for both geriatric 
(7.3%) and general medical conditions (26.1%), compared to 
diagnosis indicators for geriatric (37.5%) and general medical 
conditions (49.5%). As shown in Table 2, globally, a lower 
adherence to recommended processes of care was registered for 
geriatric compared to general medical conditions. Indeed, 
univariate analysis results showed a significant negative relation- 
ship of adherence in geriatric compared to general medical 
conditions in diagnostic (69.3%±32.6% vs 82.2%±20.7%%; 
p<0.001), therapeutic (48.4%±37.3% vs 67.6%±32.3%; 
p<0.001) and screening and prevention (43.6%; ±28.7% vs 
72.1%±24.5%; p<0.001) domains of care. 

Results of the multiple linear regression analysis are presented in 
Table 3. Adherence to diagnostic recommended processes for 
general medical conditions was significandy higher in older 
patients ((3-coeff= 10.6, p<0.001), males (p-coeff= -6.2, 
p = 0.028), married subjects (P-coeff = 8.8, p = 0.013), with lower 
length of stay at NH (P-coeff= -4.7, p = 0.007), with higher 14 
CIRS-G severity index (P-coeff = 18.7, p = 0.004) and lower 14 
CIRS-G comorbidity index (P-coeff = —3.1, p = 0.015), and in 
patients who had not been referred to the emergency department 
(P-coeff = —7.2, p = 0.018), whereas it was significantly lower in 
patients discharged from NH (P-coeff = —9.2, p = 0.01) compared 
to those who died. Finally, a greater level of function and mobility 
was associated to better adherence to diagnostic QIs for general 
medical conditions (P-coeff = —3.1, p = 0.051). 

Adherence to diagnostic recommended processes in geriatric 
conditions was significandy associated with higher 14 CIRS-G 
severity index (P-coeff =21, p<0.001), male gender (P- 
coeff= -8.9, p = 0.049) and with being still resident in NH (P- 
coeff = 11.7, p = 0.049). 

Adherence to therapy recommended processes for general 
medical conditions was significantly associated with higher 14 
CIRS-G comorbidity index (P-coeff = 5.3, p<0.001) and better 
level of function and mobility (P-coeff = —4.9, p = 0.035), whereas 
for geriatric conditions, it was significandy higher in younger 
subjects (P-coeff = -8.9, p = 0.025). 

Finally, in the regression models performed to investigate the 
adherence to screening and prevention recommended processes 
for general medical conditions it was significantly better in patients 
still resident in NH (P-coeff = 9.7, p = 0.01 1), whereas for geriatric 
conditions it was significantly better in patients with higher 14 



CIRS-G severity index (P-coeff = 14.7, p = 0.002) and worse in 
patients discharged from NH (P-coeff = -8.9, p = 0.028). 

Discussion 

Unlike acute hospital care and primary care activity, the quality 
of long-term care for the elderly provided in NHs has long been 
neglected. To our knowledge, this is the first study performed in 
Italy that has evaluated the quality of care delivered in this setting 
by using a validated set of indicators that reflect the adherence to 
current evidence-based processes of care. 

The results of our study show that appropriateness of processes 
of care for vulnerable elders is extremely variable according to 
ACOVE QIs, both in different conditions and in specific domains 
of care. Among general medical conditions, diabetes management 
showed the greatest deficiencies. This result is congruent with 
other studies reporting poor quality of care in NHs for diabetes, 
particularly in respect to preventive interventions [15,16], and 
may reflect serious difficulties in the access to specialized services 
[17]. In contrast, adequate adherence to recommended processes 
of care was found for other general conditions, such as heart 
failure, hypertension and pneumonia. One explanation for this 
disparity may be inherent in the skills necessary for many processes 
of care related to these conditions [13]. 

Significant deficiencies exist in most geriatric conditions, such as 
pressure ulcers, falls and dementia, while recommended interven- 
tions for urinary incontinence were commonly performed. This 
higher adherence for urinary incontinence management may be 
attributed to administrative and organizational factors in our 
healthcare system since safeguards against incontinence (pads/ 
diapers and/or catheters) are free of charge for incontinent 
patients. On the contrary, in accordance with previous studies 
[18,19], appropriate toileting programs and behavioral treatments 
are adequately performed in only 25% of the eligible patients; one 
possible explanation for this disparity may be detectable in the 
attitudes of physicians who often overlook the potential efficacy of 
these behavioral interventions [19]. 

Our findings, consistent with studies showing poor implemen- 
tation of evidence-based processes of care for geriatric as 
compared to general medical conditions [20], suggest the need 
for improving the training of healthcare professionals in these 
specific health needs. Certain interventions, such as the manage- 
ment of physical restraints and the use of identification bracelets, 
are not incorporated as protective standard healthcare processes in 
our context. 

It is worrisome that low adherence to recommended processes 
of care is particularly pronounced for geriatric conditions in the 
screening and prevention domains of care, and this lack of 



Table 2. Adherence to quality processes of care for general medical versus geriatric conditions by domain of care. 



Type of care 


Diagnosis 




Treatment 




Screening and Prevention 




Qls a 

measured 


Mean adherence 
rate+SD b 


QIs" 

measured 


Mean adherence 
rate+SD b 


QIs" 

measured 


Mean adherence 
rate+SD b 




N (%) 


% 


N (%) 


% 


N (%) 


% 


General medical condition 


192 (78.4) 


82.2+20.7 


219 (89.4) 


67.6+32.3 


245 (100) 


72.1+24.5 


Geriatric condition 


224 (91.4) 


69.3+32.6 


174 (71) 


48.4+37.3 


245 (100) 


43.6+28.7 


Mean difference (+SD b ) 




12.9+37.7 




19.3+49.7 




28.5+36.1 


Adherence to QIs* 




t = 4.5, 172 df, p<0.001 




t = 4.87, 157 df, p<0.001 




t= 12.3, 242 df, p-CO.001 



a Quality Indicators; b Standard Deviation. 
doi:1 0.1 371 /journal.pone.0093064.t002 
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oversight may be due to negative attitudes of health professionals 
in NHs to the usefulness of preventive care in the elders. Indeed, 
counseling or screening may be perceived as insufficient and 
inefficient time-consuming activities, whereas treatment or diag- 
nostic domains, often involving simple processes of care, such as 
prescription of medications or ordering diagnostic tests, are 
considered more effective, less bothersome, and tasks easier to 
perform [13]. These results are quite consistent with those in a 
previous study conducted by some of us to estimate the adherence 
to evidence-based processes of care in acute settings, that 
highlighted the need to focus effort for improvement initiatives 
especially in the area of preventive care [21]. 

Unlike most previously published studies conducted with 
aggregated data, our findings derived from a smaller number of 
patients; nonetheless detailed information was gathered from each 
patient and represents a main strength of our study allowing us to 
point to factors that could predict adherence to ACOVE QIs, such 
as the clinical conditions, the socio-demographics of patients and 
features of long term care, for example, admission, discharge and 
length of stay in NH. Indeed, the results from the multivariate 
analyses confirm the many disparities argued in previous studies 
[22-24], women appear to receive less appropriate interventions 
for diagnosis of general and geriatric conditions, and older patients 
are more likely to receive adequate diagnostic processes of general 
medical conditions. Consistent with previous studies that exam- 
ined the effect of coexisting conditions on providing appropriate 
processes of care [22-24], interestingly, we found that quality of 
care, as measured by the ACOVE QIs, is not worse in more 
complex patients. An increased 14 CIRS-G severity index of 
comorbidity was significantly associated with more adequate 
prevention of geriatric conditions and diagnosis of general and 
geriatric conditions. 

Some potential limitations of the present study must be 
acknowledged. Processes of care were determined using medical 
record documentation which might be incomplete; it can be 
argued that availability and the quality of data correlates with 
lower estimates of adherence rates, and as underlined in previous 
surveys [13], poorer documentation is likely to be correlated with 
poorer processes of care. Data in our study were collected in a 
single NH, and concern relating to generalizability and compa- 
rability of the results may arise. The present study is intended to be 
an analytical first step in measuring the adherence to current 
evidence-based processes of care reported in medical records of 
residents in NHs in an area of Italy by using a specialized set of 
indicators. The application of ACOVE QIs, in our experience, 
provides valuable information in relation to their feasibility and 
ease of use, suggesting that these indicators, once tested in a wider 
context, might be implemented on a large scale for the evaluation 
of the quality of processes of care in NHs. On the other hand, it is 
known that there are significant differences between Northern and 
Southern Italy for many health services indicators, and despite the 
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